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TABLES  OF  BIAS  FUNCTIONS,    B      AND  B        FOR  VARIANCES 

BASED  ON  FINITE  SAMPLES  OF  PROCESSES  WITH  POWER 

LAW  SPECTRAL  DENSITIES 

J.  A.  Barnes 
ABSTRACT 

D.  W.  Allan  showed  that  if  y(t)  is  a  sample  function  of  a  random 

CL 
noise  process  with  a  power  law  spectral  density  (i.  e .  ,  S    (f)  =   h  |  f  |     ), 

then  there  is  generally  bias  to  the  estimated  variance  of  y,    defined  as 

N 

n=  1 

where  N  is  the  number  of  samples,  y  is  the  average  value  of  y(t)  over 
the  n-th  interval  of  duration  T,  T  is  the  time  between  the  beginnings  of 
any  two  successive  sample  intervals,    and 

N 

n=  1 

Allan  also  showed  that,  under  these  conditions,  the  expectation  value 
of  the  estimated  variance  is  proportional  to  T  where  [i  is  a  constant 
related  to  a,    the  exponent  in  the  spectral  density;  i.e., 

E[a    (N,  T,  t)]   «    t^  . 

y 

Based  on  this  work  one  may  define  the  two  bias  functions 


E[o    (N,  T,t)] 

B    (N,  r,  n  )  =  f 

E[a     (2,  T,  t)] 

y 


and 


B0(r,  p.)  = 


E[a2(2,  T,t)] 

y i 


2  E[a2(2,  t,t)] 

y 

where  r  =  T/t  and  the  B's  are  functions  of  u   through  their  dependence 

on  y(t). 

2 
If  one  has  a  sample  variance,    a    (N ,  T,,T,),    the  bias  functions 

y       1        1       1 

allow  one  to  give  an  unbiased  estimate  for  o^  (N   ,  T    ,  t    )  provided  the 
spectral  type  is  known  (i.e.  ,  \i   is  known). 

The  tables  give  values  of  B    (N,  r,u)  and  B    (r,  \x  )  accurate  to  four 
significant  figures  for  the  following  values  of  N,  r,  jjl  : 

u    =    -2.  0  to  2.  0  in  steps  of  0.  2; 
N  =  4,  8,  16,  32,  64,  128,  256,  512,  1024,  co  ; 

r  =    0.  001,  0.  003,  0.01,  0.03,  0.  1,  0.  2,  0.4,  0.  8,  1,  1.  01,  1.  1, 
2,  4,  8,  16,  32,  64,  128,  256,  512,  1024,  2048,  &  . 


Key  Words:     statistics,   variance,    spectral  density,   unbiased  estimate 


VI 


TABLES  OF  BIAS  FUNCTIONS,    B     AND  B    ,    FOR  VARIANCES 
BASED  ON  FINITE  SAMPLES  OF  PROCESSES  WITH  POWER 
LAW  SPECTRAL  DENSITIES 

J.  A.  Barnes 

Consider  a  random  variable  y  with  mean   m.      The  variance  of  y  is 
defined  as  the  expectation  value  of  (y   -  m)    ,    that  is 

Var  y    =  E[(y   -  m)    ]  . 

This  is  defined  as  an  average  over  the  entire  ensemble  but,    for  an 
ergodic  process,    y(t),it  can  alternatively  be  defined  as  an  average  over 
all  time,    t. 

Typically,    the  variance  of  y  is  estimated  from  a  finite  set  of 
experimental  values  according  to  the  relation 


N 


(Var  y) 


es 


t.    =  TTT  Z2    (Yi 


<y»' 


(i) 


i=  1 


N 
1    -  1 

where  <^y^>  =  —  \      y.  is  the  mean  of  the  y..      The  factor    — — —  is  used  in 

i=  1 
order  that  the  estimate  have  no  bias  for  non-correlated  y:    that  is,    one 

typically  wants  to  obtain  the  true  variance  which  would  be  obtained  as 

N  — *  co   .     For  finite  N,    the  estimated  variance  has  some  expected  value } 


N 


—  V 

N-l    l^i 


(y,  -<y>)' 


n=  1 


If  the  y     are  independent  (actually,    non-correlated  is  sufficient)  random 
i 

variables,    then  the  expected  value  of  this  estimated  variance  for  finite 


BfN,  r,u)  = 


E[a2(N,  T,t)] 
I 


E[a2(2,  T,t)] 

y 


and 


B0(r,M.)  = 


E[g2(2,T,t)] 

i i 


2  E[g2(2,   t,t)] 

y 

where  r  =  T/t  and  the  B's  are  functions  of  [i   through  their  dependence 

on  y(t). 

Z 
If  one  has  a  sample  variance,    o    (N   ,  T,t    ),    the  bias  functions 

y       1        1       1 

allow  one  to  give  an  unbiased  estimate  for  Q^  (N   ,  T    ,  t    )  provided  the 
spectral  type  is  known  (i.e.  ,  u   is  known). 

The  tables  give  values  of  B    (N,  r,  u)  and  B    (r,  u)  accurate  to  four 
significant  figures  for  the  following  values  of  N,  r,  u  : 

|jl    =    -2.  0  to  2.  0  in  steps  of  0.  2; 
N  =   4,  8,  16,  32,  64,  128,  256,  512,  1024,  co  ; 

r  =    0.  001,  0.  003,  0.  01,  0.  03,  0.  1,  0 .  2,  0.  4,  0.  8,  1,  1.01,  1.1, 
2,  4,  8,  16,  32,  64,  128,  256,  512,  1024,  2048,  co  . 
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J .  A.  Barnes 

Consider  a  random  variable  y  with  mean   m.      The  variance  of  y  is 

2 
defined  as  the  expectation  value  of  (y   -  m)    ,    that  is 

Var  y   =  E[(y  -  m)    ]  . 

This  is  defined  as  an  average  over  the  entire  ensemble  but,    for  an 
ergodic  process,    y(t),it  can  alternatively  be  defined  as  an  average  over 
all  time,    t . 

Typically,    the  variance  of  y  is  estimated  from  a  finite  set  of 
experimental  values  according  to  the  relation 


N 


(Var  y) 


es 


t.  =  ih  z2  (yi 


-<y»' 


(i) 


i=  1 


N 
where  <(y^>  =  —    \      y.  is  the  mean  of  the  y..      The  factor  is  used  in 

i=l 

order  that  the  estimate  have  no  bias  for  non-correlated  y:    that  is,    one 

typically  wants  to  obtain  the  true  variance  which  would  be  obtained  as 
N  — *  cd   .     For  finite  N,    the  estimated  variance  has  some  expected  value t 


N 


N 


*-!>. 


<y> 


n=  1 


If  the  y     are  independent  (actually,    non -correlated  is  sufficient)  random 
i 

variables,    then  the  expected  value  of  this  estimated  variance  for  finite 


N  is  exactly  equal  to  the  true  (infinite  N)  variance.     If  the  y.  are  cor- 
related,   however,    the  estimate  based  on  (1)  may  indeed  be  biased. 
This  fact  has  been  recognized  and  discussed  in  some  detail  for  the  case 
of  power  law  spectral  densities  by  Allan  \_l]- 

The  Bias  Functions,    B     and  B 

Following  Allan  (_lj,    consider  a  random  process  y(t)  with  con- 
tinuous sample  functions.     We  assume  that  y(t)  has  a  spectral  density, 
S    (f),    which  obeys  the  law 

y 

S   (f)  =  h|f|a,    f/<|f|<fu  (2) 

where  h  is  a  constant,    the  limit  frequencies  in  and  f     satisfy  the  relations 


0<f/7<<f<ao     , 
It  u 

and  any  intervals  of  time,    At,    of  any  significance  satisfy  the  relations 

1  A  1 

«  At  << 


f       ^   -"  ^  f . 
u  I 

In  short,    y(t)  has  a  power  law  spectral  density  over  the  entire  range  of 
significance . 

Consider  a  measurement  process  which  determines  an  average 
value  of  y(t)  over  the  interval  t  to  t  +  j  .      That  is, 

i  rt+T 

y(t)  =  -    /  y(t')df  .  (3) 

T    t 

One,    now,    may  determine  an  estimated  variance  from  a  group  of  N  such 
measurements  spaced  every  T  units  of  time;  that  is, 


N 

y<N'T'T>=NTil]Jy(t+nT)       N^V^'i     ,  (4) 

n=  1 


which  is  called  the  "Allan  variance"  [l]  . 

Allan  [l]  has  shown  that  under  these  conditions, 


E    a2  (N,  T,  t) 


<x  t     ,    N  and  T/t  constant, 


where  u   is  related    to  a  according  to  the  mapping  shown  in  Figure  1 
(see  references   1  and  2  ).     The  relation  between  \x   and  a  may  be  given  as 

-2  if  a  >  1 
|jl=      \       -a  -1  if  -3<  a  <  1 

not  defined  otherwise. 

This  mapping  involves  a  simple  extension  of  Allan's  work  [  lj  to  the 
range  0<  (J.  <  2.      This  extension  was  also  mentioned  in  |_3J. 

Allan  L  0  considered  in  some  detail  the  case  where  T  =   t.      This 
is  the  case  of  exactly  adjacent  sample  averages --no  "dead  time"  between 
measurements.     Allan  defined  a  function,   X  (N,  \i),    as  follows 

E|~C72(N,  T,T)1 

X(N,u)  =   — 1-| J  ,  (5) 

E[a    (2,t,t)J 

where  it  is  again  assumed  that 


It  should  be  noted  that  in  reference      1    the  exponent,    a,    corresponds  to 
the  spectrum  of  phase  fluctuations  while  variances  are  taken  over 
average  frequency  fluctuations.     In  the  present  paper,    a  is  equal  to  the 
exponent,    a,    in  [[ljplus  two.     Thus,    in  this  paper,    all  considerations 
are  confined  to  one  variable,    y(t)  (analogous  to  frequency  in  Llj)  and 
the  spectral  density  of  y,    S    (f).      This  paper  does  not  consider  the 
spectrum  of  the  integral  of  y(t). 


FIG.  I     H--<*     MAPPING 


4 


a    (N,  t,t) 

y 


a    T     ,    N  constant 


Allan  shows  [lj  that  experimental  evaluations  of  X  (N,  |j. )  may  be  used  to 
infer  \x    and  hence  the  spectral  type  by  use  of  the  mapping  of  Figure   1. 

Since  many  experiments  actually  have  dead  time  present,    it  is  of 
value  to  make  two  different  extensions  of  this  function,   X  (N,  \x).     First, 


define  B     (N,  r,  u)  by  the  relations 


EJV(N,  T,t)] 


B     (N,  r,u)   = 

E   (T(2,  T.T) 
L  y  J 


where  r  =  T/t  and 


a2  (J 

y 


;.  t,  t  )j 


<x    t     ,    N  and  r  constant 


The  second  function,    B     (r,  \x),    is  defined  according  to  the  relation 


E[a2(2,  T,T) 

B2<^> s  Mr, — ;- 

E  a    (2,t,t) 


where  r  =  T/T.     In  words,    B     is  the  ratio  of  the  expected  variance  for 
N  samples  to  the  expected  variance  for  2  samples  (everything  else  fixed); 
while  B     is  the  ratio  of  the  expected  variance  with  dead  time  to  that  of 
no  dead  time  (with  N  =  2  and  T  held  constant).     The  B's,    then,    reflect 
bias  relative  to  N  =  2  rather  than  N  =  co  .     It  is  apparent  that  B    (N,  r=  1,  |jl) 
sX(N,  n). 

For  the  conditions  given  above  and  with  reference  to  Allan  [_lj, 
one  may  write  expressions  for  both  B     and  B    ,    as  follows: 


1  + 


B     (N,  r.n)  = 


N-l 

£ 

n=  1 


N-n 
N(N-l) 


-.1       i  M-  +  2       ,  _ .  u.  +  2       .         , ,  u  +  2 

2|nr|r  -  |nr+ir  -  |nr-l|^ 


1  + 


2|r|fl+2-|r+ll^+2-lr-llfl+2 


;  (8) 


in  particular  for  r  =   1, 


B^N,  I, is.)  = 


2(N-1)(1-2M') 


(9) 


and 


B2(r,|i)  = 


1 

1+I 


2lr'r+2  -lr+lP+2 


r-1 


|JL  +2 


2(1   -  2^) 


(10) 


except  that  by  definition,    B    (1,  [j.)  =  1.     The  magnitude  bars  are  essential 
on  the  r-1  term  when  r  <  1,    and,    indeed,    proper.     Since  Allan  |_1J  was 
involved  with  r  >  1  the  magnitude  bars  were  dropped  in  reference  1. 

For  |i.  =   0,    equations  (8),   (9),  and  (10)  are  indeterminate  of  form 

0/0  and  must  be  evaluated  by  L'Hospital's  rule.     Special  attention  must 

0 
also  be  given  when  expressions  of  the  form  0     arise. 

One  may  obtain  the  following  results: 


B    (2,r,n)  =  1 

1  N     6 

B^N,  1,1)  =~ 

B     (N,  r,  -1)  =    1  if  r  >  1 

B     (N,  r,  -2)  =    1  if  r  *  1  or  0 

B2(0,u)  =    0 

B2(l,u)=    1. 


B2(r,  2)  =   r2 

B     (r,  1)  =   j(3v   -1)  if  r  >  1 

Jr  if  0<r<l 
B2 


fr  if  0<r 
(r'-1)  =  ilifr>l 


(0  if  r  =  0 

B2(r,  -Z)  =  h  if  r  =    1 

12/3  otherwise 

Values  of  the  functions  B    (N,  r,  jjl  )  and  B    (r,  u  )  are  tabulated  on 
the  following  pages  for  values  of  N,  r,  \x   as  shown  below: 

jjl    =    -2.  0  to  2.  0  in  steps  of  0.2; 

N  =  4,  8,  16,  32,  64,  128,  256,  512,  1024,  en  ; 

r  =   0.001,0.003,0.01,0.03,0.1,0.2,0.4,0.8, 

1,  1.01,  1.  1,  2,  4,  8,  16,  32,  64,  128,  256,  512,  1024, 

2048,  co  . 

Figure  2  is  a  graphical  representation  of  B    (r,  u)  for  0<r  <Z  and 
-2<m-<2. 

Examples  of  the  use  of  the  bias  functions 

The  spectral  type,    that  is,    the  value  of  \x  ,    may  be  inferred  by 
varying  T,    the  sample  time  |_1,  2 J  .     Another  useful  way,    however,    of 
determining  the  value  of  u   is  by  using  B    (N,  r,  u  )  as  follows:    calculate 
an  estimate  of  E   a     (N,  T,  t  )1  and  of  E  \aZ  (2,  T,  t  )land  hence  B    (N,  r,  (jl); 

then  by  use  of  the  tables  the  value  of  u   may  be  inferred. 

2 
Suppose  one  has  an  experimental  value  of  a     (N  ,  T    ,  t    )  and  its 

spectral  type  is  known --that  is,    (J.   is  known.     Suppose  also  that  one 


wishes  to  know  the  variance  at  some  other  set  of  measurement  para- 
meters,   N  ,   T   ,  t    .     An  ui 
calculated  by  the  equation: 


2 
meters,    N_,   T\,  T_.     An  unbiased  estimate  of  a     (N_,,  T\,  t_)  may  be 
2        2       2  y       2       2       2 


a    (NTt) 
y        Z        Z       Z 


W 


Bl(N2'rZ^)B2(r2^> 
B1(N1,r1,(x)B2(r1,|a.) 


a    (NT     t    ) 
y       1        1       1 


where  r     =    T1/T1  and  r?  =   T?/T 


Obviously  one  might  be  interested  in  N     =  co  .     In  this  case  if  |jl  >  0, 

2 
the  expected  value  of  a     (co,  T   ,  t    )  is  also  infinite.     This  is  true  because. 

y  Z      Z 


Lim 

N-co 
Z 


B(N.r,  ,*)=.. 


is  a 


for  |a  >  0. 

Also,    it  should  be  noted  that,    for  [x  -  Z,    E   a     (N,  T,  t) 
function  of  f /;  for  any  N>Z,   T,  t,    even  though  B    (N,  r,  Z)  and  B    (r,  2) 
as  determined  from  (8),   (9),  and  (10)  are  finite  and  well  behaved  [3]. 
In  this  region,    u  ~  Z,    the  low  frequency  behavior  is  critically  important. 
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TABLES  OF  B     AND  B 

J.  C* 

The  tables  are  photographic  reproductions  of  the  computer  output. 
Each  entry  for  the  value  of  the  functions,    B     and  B     consists  of  a 
decimal  number  followed  by  an  integer  which  is  the  exponent  of  10.     Ten 

raised  to  this  power  should  multiply  the  decimal  number.      Thus  the 

3 
table  entry  2.  752  +  003  could  be  written  2.  752   X10     or,    simply  2752. 

Similarly,    "9.869  -001"  =   9.869    X  10_1   =    0.9869. 
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NBS  TECHNICAL  PUBLICATIONS 


PERIODICALS 

JOURNAL  OF  RESEARCH  reports  National 
Bureau  of  Standards  research  and  development  in 
physics,  mathematics,  chemistry,  and  engineering. 
Comprehensive  scientific  papers  give  complete  details 
of  the  work,  including  laboratory  data,  experimental 
procedures,  and  theoretical  and  mathematical  analy- 
ses. Illustrated  with  photographs,  drawings,  and 
charts. 

Published  in  three  sections,  available  separately: 

•  Physics  and  Chemistry 

Papers  of  interest  primarily  to  scientists  working  in 
these  fields.  This  section  covers  a  broad  range  of 
physical  and  chemical  research,  with  major  emphasis 
on  standards  of  physical  measurement,  fundamental 
constants,  and  properties  of  matter.  Issued  six  times 
a  year.  Annual  subscription:  Domestic,  $6.00:  for- 
eign, $7.25*. 

•  Mathematical  Sciences 

Studies  and  compilations  designed  mainly  for  the 
mathematician  and  theoretical  physicist.  Topics  in 
mathematical  statistics,  theory,  of  experiment  design, 
numerical  analysis,  theoretical  physics  and  chemis- 
try, logical  design  and  programming  of  computers 
and  computer  systems.  Short  numerical  tables. 
Issued  quarterly.  Annual  subscription:  Domestic, 
$2.25;  foreign,  $2.75*. 

•  Engineering  and  Instrumentation 

Reporting  results  of  interest  chiefly  to  the  engineer 
and  the  applied  scientist.  This  section  includes  many 
of  the  new  developments  in  instrumentation  resulting 
from  the  Bureau's  work  in  physical  measurement, 
data  processing,  and  development  of  test  methods. 
It  will  also  cover  some  of  the  work  in  acoustics, 
applied  mechanics,  building  research,  and  cryogenic 
engineering.  Issued  quarterly.  Annual  subscription: 
Domestic,  $2.75;  foreign,  $3.50*. 

TECHNICAL  NEWS  BULLETIN 

The  best  single  source  of  information  concerning 
the  Bureau's  research,  developmental,  cooperative 
and  publication  activities,  this  monthly  publication 
is  designed  for  the  industry-oriented  individual  whose 
daily  work  involves  intimate  contact  with  science 
and  technology — for  engineers,  chemists,  physicists, 
research  managers,  product-development  managers,  and 
company  executives.  Annual  subscription:  Domestic, 
$3.00;  foreign,  $4.00*. 

•Difference  in  price  is  due  to  extra  cost  of  foreign  mailing. 


N0NPERI0DICALS 

Applied  Mathematics  Series. 

tables,  manuals,  and  studies. 


Mathematical 


Building  Science  Series.  Research  results,  test 
methods,  and  performance  criteria  of  building  ma- 
terials, components,  systems,  and  structures. 

Handbooks.  Recommended  codes  of  engineering 
and  industrial  practice  (including  safety  codes)  de- 
veloped in  cooperation  with  interested  industries, 
professional  organizations,  and  regulatory  bodies. 

Special  Publications.  Proceedings  of  NBS  con- 
ferences, bibliographies,  annual  reports,  wall  charts, 
pamphlets,  etc. 

Monographs.  Major  contributions  to  the  techni- 
cal literature  on  various  subjects  related  to  the 
Bureau's  scientific  and  technical  activities. 

National    Standard    Reference    Data    Series. 

NSRDS  provides  quantitative  data  on  the  physical 
and  chemical  properties  of  materials,  compiled  from 
the  world's  literature  and  critically  evaluated. 

Product  Standards.  Provide  requirements  for 
sizes,  types,  quality  and  methods  for  testing  various 
industrial  products.  These  standards  are  developed 
cooperatively  with  interested  Government  and  in- 
dustry groups  and  provide  the  basis  for  common 
understanding  of  product  characteristics  for  both 
buyers  and  sellers.  Their  use  is  voluntary. 

Technical  Notes.  This  series  consists  of  com- 
munications and  reports  (covering  both  other  agency 
and  NBS-sponsored  work)  of  limited  or  transitory 
interest. 

CLEARINGHOUSE 

The  Clearinghouse  for  Federal  Scientific  and 
Technical  Information,  operated  by  NBS,  supplies 
unclassified  information  related  to  Government- 
generated  science  and  technology  in  defense,  space, 
atomic  energy,  and  other  national  programs.  For 
further  information  on  Clearinghouse  services,  write: 

Clearinghouse 

U.S.  Department  of  Commerce 

Springfield,  Virginia     22151 
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